How to Address Smart Homes with a Social Robot? A Multi-modal Corpus of User Interactions with an Intelligent Environment
نویسندگان
چکیده
In order to explore intuitive verbal and non-verbal interfaces in smart environments we recorded user interactions with an intelligent apartment. Besides offering various interactive capabilities itself, the apartment is also inhabited by a social robot that is available as a humanoid interface. This paper presents a multi-modal corpus that contains goal-directed actions of naive users in attempts to solve a number of predefined tasks. Alongside audio and video recordings, our data-set consists of large amount of temporally aligned sensory data and system behavior provided by the environment and its interactive components. Non-verbal system responses such as changes in light or display contents, as well as robot and apartment utterances and gestures serve as a rich basis for later in-depth analysis. Manual annotations provide further information about meta data like the current course of study and user behavior including the incorporated modality, all literal utterances, language features, emotional expressions, foci of attention, and addressees.
منابع مشابه
Towards Simulating Humans in Augmented Multi-party Interaction
Human-computer interaction requires modeling of the user. A user profile typically contains preferences, interests, characteristics, and interaction behavior. However, in its multimodal interaction with a smart environment the user displays characteristics that show how the user, not necessarily consciously, verbally and nonverbally provides the smart environment with useful input and feedback....
متن کاملAn Interaction-Centric Dataset for Learning Automation Rules in Smart Homes
The term smart home refers to a living environment that by its connected sensors and actuators is capable of providing intelligent and contextualised support to its user. This may result in automated behaviors that blends into the user’s daily life. However, currently most smart homes do not provide such intelligent support. A first step towards such intelligent capabilities lies in learning au...
متن کاملTowards Robotic Smart Homes
The nowadays smart homes try to move from conventional remote-controlled houses to intelligent environments. The focus has been made in blending high-tech computing into the home environment and in substituting the interaction with a box on a table by different friendly & intelligent HMI devices. Nevertheless, the introduction of real robots in home environment isn’t treated yet. How will be th...
متن کاملSmart Homes Can Be Smarter
Smart Homes have become firmly established as an active research area with potential for huge social and economic benefits. The concept of a Smart Home refers to the enrichment of a living environment with technology in order to offer improved habitual support to its inhabitants and therefore an improved quality of life for them. In this article we purport how advances from the device and techn...
متن کاملLearning-Based Energy Management System for Scheduling of Appliances inside Smart Homes
Improper designs of the demand response programs can lead to numerous problems such as customer dissatisfaction and lower participation in these programs. In this paper, a home energy management system is designed which schedules appliances of smart homes based on the user’s specific behavior to address these issues. Two types of demand response programs are proposed for each house which are sh...
متن کامل